About

Vaibbhav B Vasa is a highly skilled Senior Data Engineer with over 3.95 years of experience in developing applications on a variety of languages and technology stacks. He has a strong background in Computer Science fundamentals, and is well-versed in Data Engineering, Spark, Hadoop, Apache Airflow, ETL, SQL, Kafka, GCP, AWS, Azure, Mobile, Kubernetes, Docker, Java, Big Data, Research Scientist, Microservices, Python, MapReduce, Scala, MySQL, MongoDB, Apache Hive, and Backend. Currently, Vaibbhav is working as a Data Engineer III at navi, where he is responsible for managing data at a huge scale. Prior to this, he worked as a Data Engineer II at InMobi, where he played a key role in planning, deploying, and upgrading the entire software stack in GCP and Azure using Microservices and Distributed systems. He also managed the underlying ETL jobs to efficiently process and store the data. As an Individual Contributor & Teamwork, he achieved several milestones, including consuming, storing, and managing petabyte-scale data, improving SLA by 4 hours by migrating various Hadoop jobs to Spark using Scala, onboarding the entire stack of Roposo & Shop101 to Trino reduced infra cost by almost 45%, deploying self-managed Airflow for scheduling ETL Jobs processing data in Spark & Trino, and writing SQL queries and custom UDFs to aggregate raw data for business needs. He was also the SME for Trino/Presto for the entire Glance, where he researched, experimented, and deployed various configuration and session properties of Trino to utilize the resources efficiently. Before joining InMobi, Vaibbhav worked as a Data Engineer at Adobe, where he was responsible for data reprocessing for billions of records to cleanse the data in Adobe Analytics. He also migrated legacy Apache Pig ETL process to WFE (Apache Airflow) for scaling and processing higher volumes of data. Vaibbhav holds a Post Graduate Program in Big Data Engineering from Birla Institute of Technology and Science, Pilani, a Post Graduation Program in Data Science Engineering from Great Lakes Institute of Management, and a Bachelor of Technology (B.Tech.) in Computer Science and Engineering from KIIT University.